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ABSTRACT: 


The theory of MCs is a smart combination of Linear Algebra and Probability theory offering ideal 
conditions for the study and mathematical modelling of situations depending on random variables and 
finding important applications to problems of Artificial Intelligence. In the paper at hands an absorbing 
Markov chain is introduced on the phases of decision making and an application is presented illustrating 
the importance of the constructed model in practice. Further, the Case-Based Reasoning process is 
modeled with the help of an ergodic Markov chain defined on its steps and through it a measure is 
obtained for the effectiveness of a Case-Based Reasoning system. 

Keywords: Markov Chains (MC’s), Absorbing MC’s (AMC’s), Ergodic MC’s (EMC’s), Artificial Intelligence 
(AI), Decision Making (DM), Case-Based Reasoning (CBR). 


INTRODUCTION 

Artificial intelligence (AI) is the branch of 
Computer Science that focuses on the creation of 
intelligent machines which work and react like 
humans. The term Al was first coined by John 
McCarthy (Figure 1) in 1956 when he held the 
first academic conference on the subject. But the 
journey to understand if machines can truly 
think began much before that. 


Figure 1: J. McCarthy (1927-2011) 


Al has roots in mathematics, engineering, 
technology and science and as a synthesis of 
ideas from all those fields has created a new 
situation that is only just beginning to generate 
enormous changes and benefits to the human 
society. 


Probability theory, dealing with situations of 


uncertainty caused by randomness, is included 
among the mathematical tools used in Al 
applications. In particular, the Markov Chain 
(MC) theory is a smart combination of 
Probability and Linear Algebra that is used in 
problems of AI to model something that 
is in discrete states, but it is not fully understood 
how it is evolved [1]. 


The purpose of the paper at hands is to present 
applications of finite MC’s to problems of Al 
involving Decision Making (DM) and Case- 
Based Reasoning (CBR) systems. The paper is 
organized as follows: In the second section the 
elements of theory of finite MC’s are recalled 
which are necessary for the understanding of 
the rest of the work. In the third section an 
absorbing MC (AMC)is introduced on the phases 
of the decision making and an application is 
presented illustrating the importance of the 
constructed model. In the fourth section the CBR 
process is modeled with the help of an ergodic 
MC (EMC) having as states the steps of CBR and 
through it a measure is obtained for the 
effectiveness of a CBR system. The paper ends 
with the final conclusions presented in the fifth 
section. 
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MARKOV CHAINS 

Roughly speaking a Markov chain (MQ) is a 
stochastic process that moves in a sequence of 
steps (phases) through a set of states and has a 
one-step memory. In other words, the probability 
of entering a certain state in a certain step 
depends on the state occupied in the previous 
step and not in earlier steps. This is known as the 
Markov property. However, for being able to 
model as many real life situations as possible by 
using MCs, one could accept in practice that the 
probability of entering a certain state in a 
certain step, although it may not be completely 
independent of previous steps, it mainly depends 
on the state occupied in the previous step [2]. 


The basic concepts of MCs were introduced by 
Andrey Markov (Figure 2) in 1907 on coding 
literal texts. 


Figure 2: A. Markov (1856-1922) 


Since then the MC theory was developed by a 
number of leading mathematicians, such as A. 
Kolmogorov, W. Feller, etc. However, only from 
the 1960’s the importance of this theory to the 
natural, social and applied sciences has been 
recognized [1-7]. 


1. Finite Markov Chains 

When the set of states of a MC is a finite set, then 
we speak about a finite MC. For general facts on 
finite MCs we refer to Chapter 2 of the book [8]. 


Let us consider a finite MC with n states, say S:, 
8», ... Sn, Where nis a non negative integer, n> 2. 
Denote by py the transition probability from 
state 8; to state §;, i,j = 1, 2..., n; then the matrix 
A= [pj] is called the transition matrix of the MC. 
Since the transition from a state to anyone of the 


c 


other states (including its self) is the certain 
event, we have that 

Pat Pi2t--- + Pin =1(1), fori =1..., n 

(1) 


The row-matrix P, = [p/” p™.. pr”, Rnown as 
the probability vector of the MC, gives the 
probabilities p{” for the MC to be in state /at step 
k, for i= 1, 2...., nand k= O, 1, 2,... Obviously we 
have again that 


p+ pp + .... +p, =1 (2) 


Using conditional probabilities on can show ([8], 
Chapter 2, Proposition 1) that Py+7= PA (3), for all 
non negative integers k. Therefore a 
straightforward induction on k gives that 
P. = PA‘ (4), for all integers k>1. Equations (3) 
and (4) enable one to make short run forecasts 
for the evolution of the various situations that 
can be represented by a finite MC. In practical 


applications we usually distinguish between two 
types of finite MCs, the AMCs and the EMCs. 


2. Absorbing Markov Chains 

A state of a MC is called absorbing if, once 
entered, it cannot be left. Further a MC is said to 
be an AMC if it has at least one absorbing state 
and if from every state it is possible to reach an 
absorbing state, not necessarily in one step. 


Working with an AMC with & absorbing states, 7 
<k <n, one brings its transition matrix A to its 
canonical (or standard) form A" by listing the 
absorbing states first and then makes a partition 
of A* to sub-matrices as follows 


In the above partition of A% denotes the 
unitary kX k matrix, Ois a zero matrix, Ris the 
(n — k)X k transition matrix from the non- 
absorbing to the absorbing states and Qis the (n 
—k)X (n — hk) transition matrix between the non 
absorbing states. 
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It can be shown ([9], Section 2) that the square 
matrix In-r- @ where In_, denotes the unitary n- 
k X n-k matrix is always an invertible matrix. 
The fundamental matrix N of the AMC is defined 
to be the inverse matrix of 

In-z — Q. Therefore ([10], Section 2.4) 


N = [nl = Ch-e — Q 7 


1 

= —— adj UU, , - ; 

D (1, -O) dj (Ia, -Q) (6) 
In equation (6) DU, -» — Q@ and 
adj Un-rk — @) denote the determinant and the 
adjoin of the matrix /,-% — Q respectively It is 
recalled that the adjoin of a matrix M is the 
matrix of the algebraic complements of the 
transpose matrix M‘ of M, which is obtained by 
turning the rows of M to columns and vice versa. 
It is also recalled that the algebraic complement 
m,of an element mj of M is calculated by the 
formula 
my = (-1)'!Dy (7), where D; is the determinant of 
the matrix obtained by deleting the +th row and 
the #th column of M. 


It is well known ([7], Chapter 3) that the element 
ny of the fundamental matrix N gives the mean 
number of times in state 8; before the absorption, 
when the starting state of the AMC is 8;, where 8; 
and §;are non absorbing states. 


8. Ergodic Markov Chains 

A MC is said to be an EMC, if it is possible to go 
between any two states, not necessarily in one 
step. It is well known ([7], Theorem 5.1.1) 
that, as the number of its steps tends to infinity 
(long run), an EMC tends to an equilibrium 
situation, in which the probability vector P, 
takes a constant price P = [p; pz.... prj, called the 
limiting probability vector of the EMC. Therefore, 
as a direct consequence of equation (3), the 
equilibrium situation is characterized by the 
equation 


P=PA (8), with pit pot ...t pa= 1. 


The entries of P express the probabilities of the 
EMC to be in each of its states in the long run, or 
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in other words the importance (gravity) of each 
state of the EMC. 


Let us now demote with mj; the mean number of 
times in state 8, between two successive 
occurrences of the state §;, i, j = 1, 2,... n. It is well 


known then that m; “a (9), where p; and p; 
j 

are the corresponding limiting probabilities ([7], 

Theorem 6.2.3) 


AN AMC MODEL FOR DECISION MAKING 

DM is the process of choosing a solution between 
two or more alternatives, aiming to achieve the 
best possible results for a given problem. 
Obviously the above process has sense if, and 
only if, there exist more than one feasible 
solutions and a suitable criterion that helps the 
decision maker to choose the best among these 
solutions. It is recalled that a solution is 
characterized as feasible, if it satisfies all the 
restrictions imposed by the statement of the 
problem as well as all natural restrictions 
imposed onto the problem by the real system. 
For example, if x denotes the quantity of the 
stock of a product, it must be x >0. The choice of 
the suitable criterion, especially when the 
results of DM are affected by random events, 
depends upon the desired goals of the decision 
maker; e.g. optimistic or conservative criterion, 
ete. 


The rapid technological progress , the 
impressive development of the transport means, 
the globalization of our modern society, the 
enormous changes happened to the local and 
international economies and other relevant 
reasons led during the last 60-70 years to a 
continuously increasing complexity of the 
problems of our everyday life. As a result the DM 
process became in many cases a very difficult 
task, so that it is impossible to be based on the 
decision maker’s experience, intuition and skills 
only, as it usually used to happen in the past. 
Thus, from the beginning of the 1950's a 
progressive development started of a systematic 
methodology for the DM process, which is based 
on Probability Theory, Statistics, Economics, 


International Journal of Innovation (2020), Volume 10, Issue 1, Page(s):1-10 


Page | 3 


Myr 


DOI: http://doi.org/10.5281/zenodo.8662434 


Psychology, ete. and it is termed as Statistical 
Decision Theory (SDT) [11]. 


1. The Steps of the DM Process 


According to the nowadays existing standards 
the DM process involves the following steps: 

e d; Analysis of the decision problem, ie. 
understanding, simplifying and 
reformulating the problem in a way 
permitting the application of the 
principles of SDT on it. 

e dz Collection from the real system and 
interpretation of all the necessary 
information related to the problem. 

e ds Determination of all the alternative 
feasible solutions. 

e d,: Choice of the best solution in terms of 
the suitable (according to the decision 
maker’s goals and targets) criterion. 


One could add one more step to the DM process, 
the verification of the chosen decision according 
to the results obtained by applying it in practice. 
However, that step is extended to areas which 
due to their depth and importance for the 
administrative rationalism have become 
autonomous. Therefore, it is usually examined 
separately from the other steps of the DM 
process. 


Note that the first three steps of the DM process 
are continuous in the sense that the completion 
of each one of them usually needs some time, 
during which the decision maker's reasoning is 
characterized by transitions between 
hierarchically neighbouring steps. Accordingly 
its flow diagram is represented in Figure 3 
below: 


( dy) (dy (ds (ds | 
a * NY 


Figure 3: Flow diagram of 
the DM process 


ISSN: 0975 — 9808 
IJINN (2020), 10(1):1-10 


Qo Van 


a 


c 


2. The Model 

We introduce a finite MC havingas _ states the 
steps di, i = 1, 2, 3, 4, of the DM process introduced 
in the previous section. Obviously dis always 
the starting state. Further, we observe that, when 
the chain reaches the state d, (end of the DM 
process) it is impossible to leave it. This means 
that d, is the unique absorbing state of the chain. 
Therefore, since it is possible from any state to 
reach the absorbing state d, (see Figure 3), our 
MC is an AMC. 


Taking into account the flow diagram of Figure 
3 one finds that the transition matrix of the MC 
is 


dd, d, d, 


dfo 1 0 0 
A= G2/P21 O Pog 0 
d3} 0 P32 O Pag 
dio 0 0 1 


with p2tpos = Ps2tps4 = 1. 


Denote by Pi= [p:” po“? ps‘ pa‘?] the probability 
vector of the MC, i = O, 1, 2...... Then, since d: is 
always the starting state, we have that Po = [10 
O O]. Therefore, applying equation (3) one finds 
that 

P; = PoA = [010 0] 

Po =PiA= [pai O P23 0] (10) 

Ps = Py A = [0 pait posps2 O Ppospaal 

P, = PsA = [p2i?+ paip2sps2 O p2ipest P23" P32 P23Psa ] 
and so on. 


We now bring the transition matrix A to its 
standard form A* and we make a partition of A* 
to sub-matrices as follows: 


d, d, d, 3 

d,j 1: 0 0 0 
at. 4/010 1 OF} 
d,| 0 Px O- Py 
i 


3 
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0 1 0O 
ThenQ=|p,, 0 p,,| and applying equation 
0 py, O 


(6) one finds that 


1 1-pyPo, 1 Prys 
N=(13-Q)" a P23P34 Px 1 Pr ° [ngl, 


Px P32 P32 Px 


i, j = 12,3. Therefore, since in our case d; is 
always the starting state, the mean number of 
steps taken before the absorption is given by 


_~x _ 2+P23D34 
a dM ~— PegPzq (1). 
Obviously, the greater is the value of t, the more 
the difficulties that the decision maker faces 
during the DM process. In other words t provides 
an indication for the difficulty of the DM process. 
Another indication for the difficulty of the DM 
process is the time spent by the decision maker 
to complete the process, ete. 


8. An Application 

A company, say A, must decide about the proper 
place for building a new factory. The manager of 
the company wants to determine the probability 
for the DM process to be terminated in four steps 
and to estimate the mean number of steps 
needed before taking the decision. Here we 
analyze the DM process according to the 
previously presented AMC model: 


d;: Analysis of the DM problem 


The analysis of the problem has shown that the 
profitability of the company’s decision depends 
on the quality of the products of the existing in 
the area competitive companies. 


ds: Collection and interpretation of the necessary 
information 


It turns out that there is only one competitive 
company in the area, say B, which produces 
three different products, say W:, W2 and Ws. 
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dz: Determination of the feasible solutions 


The funds available for the company A to build 
its new factory, as well as the already existing in 
the area factories and storehouses of the two 
companies A and B, suggest four favourable 
places , say P;, Po, Ps and P, for the possible 
construction of the new factory. However, some 
additional information became necessary at this 
point in order to proceed to the choice of the best 
place. 


ds — dz Going back from ds to dz 


The market's research has shown that the 
expected net profits for the company A with 
respect to the favourable places for the 
construction of the new factory and the types of 
the products of the company B are those shown 
in Table 1 


Table: Expected net profits for the company A 


PP, P, P, 
W,[3 8 5 4 
Wo|4 2 6 5 
W3/2 1 1 -1 


d. — ds: New transition from dz to ds 


From Table 1 it becomes evident that the feasible 
solution P,is worse than P3 and therefore P, is 
rejected. 


d.: Choice of the best solution 


The management of the company does not want 
to risk having low profits from the construction 
of its new factory, which means that it must 
adopt a conservative criterion for the choice of 
the best place for building it. Such a criterion 
that is frequently used is the Wald’s criterion, 
which is based on the Murphy’s law stating that 
the worst possible fact to be happen will happen. 
That criterion suggests to maximize the minimal 
possible for each case profits. In other words, 
since the minimal expected profit from the 
choice of Pi is 2 monetary units and the minimal 
profit from the choice of P2 and of Ps; is 1 
monetary unit (see Table 1), according to the 
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Wald’s criterion the place P; must be chosen for 
building the new factory. 


From the above analysis of the DM process it 
becomes evident that px= O and pz3= 1. We also 


1 
claim that ps2 = pss = ai In fact, when the MC 


reaches the state ds for first time, the probability 
of returning to dz in the next step is 1, since the 
collection and interpretation of new information 
is necessary. However, the second time that the 
MC reaches dz the probability of returning to dz 
in the next step is O, since no more information 
is needed for the choice of the best solution. 
Therefore the transition probability ps2 is equal 


to the mean value at and ps4 = 1- ps2= 5! 


Replacing those values of the transition 
probabilities to the third of equations (10) one 


1 
finds that Ps = [0 05 O 0.5], ie. pu® >A 


Therefore, the probability for the DM process to 
be terminated in four steps is 50%. 


Further, from equation (11) one obtains that 


05 1 1 
N=>5/0 1 1 
0 05 1 


Therefore n= 1and ny = niz = 2. Thus, the mean 
number of steps for the completion of the DM 
process is t = 5 steps. 


AN EMC MODEL FOR CBR 

CBR is the process of solving problems based on 
the solutions of previously solved analogous 
problems (past cases). For example, a physician 
who cures a patient based on the therapy that 
has previously applied to patients presenting 
similar symptoms is using the CBR 
methodology. The use of computers enables the 
CBR systems to preserve a_ continuously 
increasing “library” of past cases and to retrieve 
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in each case the suitable one for solving the 
corresponding new problem. 


CBR first appeared in commercial systems in 
early 1990’s and since then has been sued to 
create numerous applications in a wide range of 
domains including diagnosis, help-desk, 
assessment, decision support, design, etc. 
Organizations as diverse as IBM, VISA 
International, Volkswagen, British Airways, 
NASA, ete. have already made use of CBR in the 
above mentioned domains and in many more 
that are easily imaginable. 


1. The Steps of the CBR Process 

CBR has been formalized for purposes of 
computer and human reasoning as a four steps 
process involving the following actions: 

e R: Retrieve the most similar to the new 
problem past case. 

e Re Reuse the information and 
knowledge of the retrieved case for 
designing the solution of the new 
problem. 

e Rs Revise the proposed solution for use 
with the new problem. . 

e R, Retain the part of this experience 
likely to be useful for future problem- 
solving. 


Through the revision the solution is tested for 
success. If successful, the revised solution is 
directly retained in the CBR system’s library; 
otherwise it is repaired and evaluated again. 
When the final result is a failure, the system tries 
to compare it to a previous analogous failure 
(transfer from Rs back to R;) and uses it in order 
to understand the present failure, which is 
finally retained in the library. When the CBR 
process is completed in R,, it is assumed that a 
new analogous problem is forwarded to the 
system for solution. Therefore the process is 
transferred back to R: and a new circle is 
repeated. According to the above description the 
flow diagram of the CBR process can be 
graphically represented as shown in Figure 4. 
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Figure 4: The flow diagram of the CBR process 


For more details about the CBR process and 
methods we refer to [12] and to the relevant 
references included in that paper. 


2. The Model 

We introduce a finite MC having as states the 
four steps of the CBR process that have been 
described in the previous section. From the flow 
diagram of Figure 4 it becomes evident that in 
this case we have an EMC with transition matrix 


R, R, R, R, 
R| 0 1 O 0 
R,| 0 O 1 0 

A = ? 
Ry] Ps, 9 Ps, Pag 
R,| 1 0 O 0 


where P37 + P33 + Pps4= 1. 


Further, by equation (8) one finds that in the 
long run we have for the equilibrium situation of 
the EMC 


[p, Pr Px p,|=[P, Pr P3 p,|Aor 
[P,P Ps Psl= 
[PB +P, Pr PotBPs Pipa] 


Consequently it turns out that 
P, = P3P31 + Pas P2= Pir P3= Po + P3P33> 
P4= P3P34 (2) 


Adding by members the first three of the 
equations (12) one finds that 


Pi + P2 + P3 = P3P31 + Pat Pi + P2 + P3P33 
> P3 = Pat P3(P31 + P33) 
=> P3 = Pat P3(1— p34) > Pa = P3P34 
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Therefore, the fourth of the equations (12) is 
equivalent to the rest of them. Consider now the 
linear system L of the first three of the equations 
(12) and of the equation pi+p2+ pst ps = 1. It is 
straightforward to check that the determinant of 
Lis equal to 


1 0 ~-p3, -I 
pa = 2 =4=-3 
76: pact a) P33 — P31 
1 il 1 1 
0 0 -p3; -l 
0 -il 0 0 
Also Dy, = =1- p33 


Therefore, by the Cramer’s rule one finds that 


= 

PL P33 

P= = = py. (13) (13). 
D 4—3p33 — P31 


In the same way one also finds that 


1= pas 

P; = ——————_ and aa a eal = 
4—3p33 - P31 4-3 p33 > Pu 

ee — (14). 

4—3 p33 - P31 


The values of the p;s give the probabilities of the 
CBR process to be in step Ri in the long run, i = 1, 
2, 3, 4, or in other words they give the 
importance (gravity) of each of the steps of the 
CBR process. Furthermore, since R: is the starting 
state of the EMC it becomes evident that the sum 
M= m4+M4+M,4 calculates the mean number 


of steps of the EMC between two successive 
occurrences of the state R,. Therefore, the mean 
number of steps for the completion of the CBR 
process will be m+], since it includes also the 
step R,. With the help of equation (9) one finds 
that 


_ Pit Pot pz _1-p4 (15) 
P4 P4 


m 
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It becomes evident that the greater is the value 
of m, the more are the difficulties during the CBR 
process. Another factor of those difficulties is the 
total time spent for the completion of the CBR 
process, which however is negligible when using 
computers. 


EXAMPLE: A physician, in order to determine the 
disease and suggest the analogous treatment of 
a patient, takes into account the diagnosis and 
treatment of a previous patient having similar 
symptoms. If the initial treatment fails to 
improve the health of the patient, then the 
physician either revises the treatment (stay to Rs 
for two successive phases), or gets a reminding 
of a previous similar failure and uses the failure 
case to improve the understanding of the 
present failure (transfer from R3 to Rj). 


Assume that the recorded statistical data show 
that the probabilities of a straightforward cure 
of the patient as well as of each of the above two 
reactions of the physician in case of failure of 
the initial treatment are equal to each other. 


Therefore ps7 = P33 = P34= 7 Then equations (13) 
and (14) give that p; = p2= : ; pare and 


ps= | That means that in this case the step of 
8 


revision (Rs) has the greatest gravity among the 
steps of the CBR process. 


Further, equation (15) gives that m = 7. 
Consequently the mean number of steps for the 
completion of the CBR process is 8. 


4, Measuring the effectiveness of a CBR system 

A CBR system should support a variety of 
retrieval mechanisms and allow them to be 
mixed when necessary. In addition, the system 
should be able to handle large case libraries 
with the retrieval time increasing with the 
number of cases. 

Let us consider a CBR system including a library 
of nm recorded past cases and let m; be the 
outcome of equation (15) for case ci, i=1,2..., 7. 
Each m;, can be stored in the system’s library 
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together with the corresponding case. Then we 
define the system’s effectiveness, say F, to be the 
mean value of the mis of its stored cases, i.e. we 


= mM, 
have that F= —— (16). 
n 


The more problems are solved through the given 
CBR system, the bigger becomes the number n of 
the stored cases in its library and therefore the 
value of £ is changing. As n is increasing it is 
normally expected that F will decrease, because 
the values of the m,’s of the new stored cases will 
be normally decreasing. In fact, the bigger is n, 
the greater would be the probability for a new 
case to have minor differences with a past case, 
and therefore the less would be the difficulty of 
solving the corresponding problem via the CBR 
process. Thus we could say that a CBR system 
“behaves well if, when n tends to infinity, then 
its effectiveness tends to 3, which, according to 
the flow-diagram of Figure 4, is equal to the 
minimum number of steps between two 
successive occurrences of Rx, 


EXAMPLE: Consider a CBR system that has been 
designed in terms of Schank’s model of dynamic 
memory for the representation of cases [13]. The 
basic idea of this model is to organize specific 
cases, which share similar properties, under a 
more general structure called a generalized 
episode (GE). During the storing of a new case, 
when a feature of it matches a feature of an 
existing past case, a new GE is created. Hence the 
memory structure of the system is in fact 
dynamic, in the sense that similar parts of two 
ease descriptions are dynamically generalized 
to anew GE and the cases are indexed under this 
GE by their different features. 


In order to calculate the effectiveness of a 
system of this type we need first to calculate the 
effectiveness of each of the GE’s contained in it. 
For example, assume that the given system 
contains a GE including three cases, say ¢:, C2 
and cs. Assume further that c:; corresponds to a 
straightforward successful application of the 
CBR process, that cz is the case described in the 
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example of the previous section, and that c3 
includes one “return” from R3 to R; and two 
“stays” to R3. Then m;= 3 and mz = 7. For 


1 
calculating ms observe first that ps7= pss= 4 and 
i 
P3s= a Therefore, the second of equations (14) 


1 
gives that ps = 9 and equation (15) gives that mz 


= 8. Thus the effectiveness of this GE is equal to 


E= ais = 6. In the same way we calculate 


the effectiveness of all the other GE’s of the CBR 
system and their mean value, which gives the 
system’s total effectiveness. 


Notice that a complex GE may contain some 
more specific GE’s including some common 
cases (see Figure 3 in page 12 of [14]). Then we 
calculate the effectiveness of the complex GE by 
considering all its cases only once, regardless if 
they belong or not to one or more of the specific 
GE’s contained in it. 


An alternative approach for the representation 
of cases in a CBR system is the category and 
exemplar model applied first to the PROTOS 
system [15]. In this model the case memory is 
embedded in a network of categories, cases and 
index pointers. Each case is associated with a 
category. Finding a case in the case library that 
matches an input description is done by 
combining the features of the new problem into 
a pointer to the category that shares most of 
these features. A new case is stored in a category 
by searching for a matching case and by 
establishing the appropriate feature indices. The 
process of calculating the effectiveness of a 
system of such type is analogous to the process 
described in the previous example, the only 
difference being that one has to work with 
categories instead of GE’s. 


In a similar way one may calculate the 
effectiveness of a system corresponding to other 
case memory models including Rissland’s and 
Ashley’s HYPO system in which cases are 
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grouped under a set of domain-specific 
dimensions [16], the MBR model of Stanfill & 
Waltz [17], designed for parallel computation 
rather than knowledge-based matching, etc. 


CONCLUSION 

The theory of MC’s is one of the mathematical 
tools that are used in applications of Al 
characterized by randomness. In the present 
work we have modeled the decision making 
process in terms of an AMC on its phases and the 
CBR process by introducing an EMC on its steps. 
Further a measure has been obtained for 
assessing the effectiveness of a CBR system and 
examples have been presented to illustrate our 
results.. 
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